Papers with Term Extraction
KPEval: Towards Fine-Grained Semantic-Based Keyphrase Evaluation (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing evaluation methods for keyphrase extraction and generation rely on exact matching with human references. |
| Approach: | They propose a framework for evaluation that includes four critical aspects: reference agreement, faithfulness, diversity, utility and semantic-based metrics. |
| Outcome: | The proposed evaluation framework correlates better with human preferences than previously proposed metrics. |